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Advanced Tests were evaluated as predictcrs of t dicbotciccs 
criterion of whether or not the candid^lte attaired the doctorat^ 
trithin a specified length of time. Hore specifically^ th^ project 
attempted to define subgroups for which .the GRE tests ha^e varying 
degrees of validity^ and to provide bicgraphical profiles of each 
subgroup as well as. the optimal predictive 'eguaticn fcr these 
subgroups. The GBE-Advanced tests were ccnsistently fcund to the 
best predictors of Ph^Dt, attainaei^t. Bouever^ the predictive accuracy 
of the GBE-Advanced test varied ccneiderably across gradoete fields 
and in dne case uithin a graduate field. Ihat i£# prediction oq the 
trhole tr^s considerably more accurate in tie **hard science** graduate 
are^s of mat hematics - and chemistry than in psychclcgy. Sithin the' 
p'sychol^ogy a rea ^ thereyuas a **ti** shaped relationship betiteen ^ 
predictability and ag^ That is^ the total saup^^ regression equation 
led to greater predictive accuracy for the yc^nger and the older age 
groups, ^e middle age group (25-26 years old) uas net crly less 
preiStictaible^^ but the errcrs in prediction tended to lead to 
underestimation o:£ their actual rate cf Ph.D. attainment. 
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THE IDENTIFICATION OF POPULATION MODERAl^RS 
AND THEIR EFFECT ON THE PREDICTION OF 
DOCTORATE ^ATTAINMENT 

Donald A* Rock 



♦Abstract 



The immediate focus of this research project was ' to evalj|ate 
the potential of GRE aptitude and advanced tests aa predictQrs of a 
dichotomous criterion ^f whether or, not the .candidate attained the 
doctorate within a specified length of time. More specifically the 
project attempted to; (1) define subgroups for which the GRE test? 
have varying deg'Tees of validity^ and (2) provide biographical pro- 
files of each' subgroup as well as the optimal predictive equation 
for^ those' subgroups. , 

-It was found that the GRE-advanced tests were consistently th^ 
best predictors of a criterion-of Ph*D* attainment* However, the - 
predictive accuracy of the GRE-advanced test varied considerably 
across graduate fields and in'one ca^se within a graduate field. 
That is, prediction on/the whole was considerably more accurate 
dn the ^'hard science'^ graduate areas of Mathematics and Chemistry 
than in Psychology. Within the psychology area there was a '"U" 
shaped relationship between predictability and age. That the 
total samp-le" regression equation led to greater" predictive accuracy 
for the "younger" and the "older" age groups* The "middle" age 
^roup was not onljf less predictable but the errors in prediction 
tend tip lead to 'underestimation of their actual rate of Ph.D/ 
attainment. Thus, the "mi'ddle" age group was characterized by 
over-achievement , , . - ' ' 
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sensitlvity^ this In turn would be reflected in the relative level 
of its predictability- ^ " 

' ♦ . Creager (1965) examined the relationship between doctorate 
attainment aind the GRE tests for NSF applicants and found modest 
but significant relationships between the tests and the criteria* 
Creager and Harmon (1966) report a study of the validity of l?oth 
tests and quaWty ratings against a" n^imber of different criteria 
including doctorate attfainment, publication counts, citation coufits, 
on the jot> ratingfr^ and composite criterion. The report validi- 
ties rsnging from .11 "to ,39, the highest validities being for the 
composite criterion. 

The immediate focu& of this research project was to evaluate " 
the potential of GRE aptitude and advanced tests as predictors of a 
dichotomous criterion of whether or not the candidate attained the 
doctorate within a specified length of time* Mor^ specifically, the 
proj-€AJt attempted to:" (1) define subgroups for which the GRE tests 
have varying degrees of validity and (2) provide biographical pro- " 
files of. each subgroup as well "as the optimal predictive equation 
for those subgroup^. 

This initial or predictive phase outlined above^ was then supple- 
mented by a second or ^'explanatory" phase. This second phase is 
essentially a mollel building process in which path analysis methods 
(Wright, 193^; Blalook, 1961) were used to trace the "causal'* role 
of the GRE tests in the decision-making process at time of application 
aa well as their direct and indirect impact on Ph.D. attainment. The* 
use of path models rather than straight predictive models allows the 
model bailder to include other salient variables in the model which 
may influence- outcomes such as *Ph,D, attainment but which would be 
operationally Impractical in the more limited prediction model. F'or 
example, if we are interested in predicting Ph.D. attainment for any 
glv^ individual at a particular university, it is the individual's 
characteristics .whicth would focus on and not environmental charac^ 
teristics of that, particular university. In this type of prediction 
model it is, of course, assumed that etrvironmetftal characteristics 
are constant for- all individuals in 'ef department at a particular 
university. - 

■ "However > in the interpretive or explanatory path model used in 
t^hi^. study, we attempted to,estimate the direct and indirect effects 
of the aptitude-achievement measures on Ph.D. attainment when analyzed 
iA cpn^xutction with graduate department quality indices (Cartter, 1964) 
and relevant variables available on the applicant. 

tjethpdology 



f ' 'Approximately 1,000 NSF applicant records in the areas of 
Psychol&gy^ Chemistry, and Mathematics were collected from the 



G 



msrglng of the Doctoftate Records File and the Office of Scientific 
Personnel (OSP) tape of the National Seaence Foundation applicants. 
These file records indicated time to ^,D. and; of course, whether 
or not th^y received one. AddltloAal biographical Information avail- 
able In the Doctorate Records File ftnd on- the' OSP tape Included sex, 
age, marital status, number of dependents, number of NSF applications 
made, and awarda received. The OSP tecords also provided Office of 
Education cod^es for the Institution- ejach applicant^ had chosen for ' 
graduate study. . ' * 

.f 

PredlcJysr Information available £tom the OSP records included 
thefGRE teats scoreS"Verbal, Quantitative, and advanced-^-as well 
as unfiergraduate grade point average and reference report average. 
The Reference report average (Harmon, 1966) Is a quantification of 
an overall ratings of the reference letters submitted In behalf of 
^n/NSF applicant. The Doctorate Records File had additional Infor- 
mation on father's and mother's education, but was too Incomplete to 
be useful for this study. 

* 

The criterion of doctorate attainment re<^ulred a judgment to be 
made concerning the time lapse to be aj^lowed before assigning an 
indlvld^yal to the attainment versus non-attainment category. It Is, 
of course, rare that one completes a doctofdte within three years, 
after the baccalaureate t In the .science fields the mean time lap^e 
is Approximately eight y^rs (Creager, 1965) > with greater deviations 
above the mean than below. If time were 'allowed for almost everybnS 
to complete a doctorat^, the study flight well suffer on both opera- 
tional as well as rational grt>unds. That not only would more of 
the people attaining doctorates have more time out and extensive, 
study tiiae (tliu^^compllcatlng the Interpretation), but more pers<)ns 
of low treasured ablflty would have achieved a doctorate under' ^ 
possibly lower standards of dlssertat Ion' and course quality. From 
the viewpoint of efficient use of resources as well as cost .of 
graduate education. It wotild seem to be desirable to select those 
Individuals capable of successfully flashing the prog^ram in a 
reasonable amount^ of tlme^ ConverselyJ[, too short a time lapse would 
ellml^te many high quality people, possibly those very able persons 
who take on ctore ambltiious dissertation projects and/or more difficult 
course offerings* ' ■ ^ *^ ' 

These considerations lead, for criterion definition purposes, to 
setting limited cutoff times for doctorate completion, . The*'dqotoi:J^e' 
completion cutoff was June 1968. Since most of the s^bj ects, ltlcl(«ied 
applied for first-year fellowships In 1958-1961, they had-seven Jtq" 
ten years from fellowship application time to attain their doc^rate* 

The matching and merglng^of the OSP' and Doctorate Reoor^a File 
was completed at the Office of Scientific Personnel. The merged tape 
was then sent, to the Educational Testing Service for. anal-ysi^. Before 
analysis ,4addltlonal Information was compiled on the chalr^cterlstlcs o 



-6- 



r 



'the institution chosen for graduate study. Cai(tter's (196A) report 
on the quality of graduate departments furnished the quality indices 
which wer-e then assigned to each candidate according to the ranking 
of the department which he attended. Additional institutional quality^ 
information was also collected from an Office of Education tape which 
include such information as: (1) proportion of faculty with doctorate, 
(2) per student expenditure^ (3) nujaber of books in the library, (4) 
income per student, 'and (5) faculty-student ratios. These particular 
"quality indices" suffer from the fact that they apply to the total 
institut'lon .and thus are not necessarily an accurate picture of the' 
graduate school or, more specifically, the graduate department itself. 

Within each major field, the sample was split ^into two random 
halves f6r validation and cross-validation purposes/ The data was , 
then analyzed using the moderated regression technique (Rock et al., 
1967). This technique not only furnishes the researcher with the 
lisual' multiple regression validity information, but also searches for 
coQsistrent biographical patterns associated *with "types" of individuals 
who, in turn, are characterized by varying levels of predictability. 
For example, this type of analysis^ enables one to determine if a'ny 
one subgroup — such ^s older NSF applicants— should have a different 
prediction equation than another subgroup. The moderated regression 
technique allows the reseai;cher to hypothesize up to five moderators 
or g^uping variables at one time. First it will form subgroups on 
each moderat9t singly &nd then it will form groups baaed -on similar 
profiles basd^^ on combinations of moderators. For examiSle, if the 
moderated regression technique were used with two possible moderators 
such as age and department quality index, it might identify a group 
^f older indiUidu^Xa^ attending low quality graduate departments who 
are unpredictable Mi^^h respect to Ph.D. attainment when GRE-test 
scores were us^d as' predictors. Since this technique requires 
complete infori^tion, the sample sizes were reduced to 779^, 845; 
and 6A3> for Ps^chology^ Mathematics^ , and Chemistry, respectively. ^ 

Within eacl\ graduate discipline the moderated regression was i 
run first on the' 
characterized by 



validation sample, This^analysis led to subgroups 
differential predictive accuracy. 



^ Potential moderators which were analyzed with respect to their 
ijnpact oh accuracV of prediction were age, sex, marital status^ 
university quality indices, and gradu^e department quality indices. 
Students attending the same institution were assigned that 

\ . ■ 



r Analyses in Psychology were based on a total of 930 observations 
9hen department quality indices were not part of the analysis. This 
was due to the fact ^that a substantsdal number of cases had to be 
dropped when the quality indices were included. 



partlculat Institution's quality ratings, as well as department ratiitgs. 
Thoae moderators which grouped individuals- Into subgroups, on the valida- 
tion sample (which in turn were characteraz'ed by dlfferenfciat prediction) 
were selected for replication on the cross-validation sample. That Is^ 
groups were formed within the crosa-^valldatlbn sample which had similar 
proflles^to the differentially predictable groups from the first sample. 
Then the appropriate group as well as total equations were ap|tlled to 
these corresponding groups In the cross-validation sample In/ an effort' 
to determine If differential predictability was a stable characteristic 
of these varlous^^bgroups.^ 

Results and Discussion 

Psychology . ^ i 

Sex had little or no effect as a moderator^ but proved to be a 
good predictor of Ph.D.' attainment. As Indicated In Table 1, sex has 



Insert Table 1 ab^ut here 



the highest single variable correlation with the criterion (-.45 In 
Sample 1 and -.34 In Sample 2) among ail the potential predictors or 
moderatora. The negative sign lndlcate<l that women are less likely to 
attain their doctorate In Psychology than are men. Further Inspection 
of Table 1 Indicates that the test variables CGHB-Verbal, Quantitative, 
and Advanced)^ one college quality index (department rating), reference 
average, and number of NSF applications have consistent (non-ze^o In 
both samples) relationships with the criterion. The department i^tlng*s 
relationship with the'crlterlon carries a negative sign, since the 
quality code Indices^ range 'from one to four, with one signifying the 
highest' (fa^llty and four the poorest quality. The remaining Institution 
quality indices appear to be too ^neral and thus not nec'essarlly 
reflect the quality of the Psychology departmentSr The correlations 
between the department, rating and the college quality Indices ran^ ^ 
from a low of --.IS for percentage of faculty with the Ph.D., to a high 
of -".51 for income per.strttdent. Indicating & large proportion of the ' 
variance In the department rating. Is not accounted for by the more 
general quality Indices. 

The relatively high correlation between the number of NSF applica- 
^ tVl<^8 made and Ph.Di^.^talnment Is somewhat artlf^ctual, since a large 
percentage of the NSF applicants in'thls study w6ra required to reapply 
iov tiielr grant- every year. Many of those students who did-not reapply 
may have either dropped out of the program or possibly felt 'that their 
p,ast performance record would not be supportive of a grant extension. 
. Thus applications made may be considered an Intermediate progress 
■ report on the way to the Ph.D. in Psychology. 
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the varloua age W^upa Indlca'ted that both the older and the' "middle" age 
groups had slmilak toeans, both of which are consistently lower than the 
youngest group* Trius^ the 'Vlddle'^ age group^ although the least predict- 
able groupi Is similar t!o the most p^redlctable .group »(the oldest group) ■ 
wltli respect to abll^lty as measured by test scores. Sutprlslngly, hoW" 
ever, the "middle'* age group (25- and 26^year olds) ,conslstently'produces 
a greater proportion of doctorates than either the younger or the older 
groups. The "middle group" Is also characterized by a loiSer' undergraduate 
grade point average than '^Ither of the remaining predictable groups. ' 
Since the "middl^" age group tends to have lower predictor scores on the 
average, yet possesses thk highest level of Ph.D. attainment, they are 
generally undeTpredlcted whefi the overall equation Is used. Thus they 
are what Is commonly referred to as overachlevera In the psychqmetrlc 
literature. ' ^ , * . - 

- It may well be that the 25- and 26-year olds have overcome their 
' somewhat mediocre ability-achievement credentials by a higher level of 
motivation and' consequently haye a. higher* rate of Ph.D. attainment. 
Unfortunately, we do not have the data to determine what. If any, other 
age-*related characteristics are operating here. These flhdlngs of 
differential predictive accuracy as well as possible motivational ^ 
differences point out the need for more biographies^ infotmation about 
graduate applicants If we are to understand andyor Infer th^ causal 
pattern underlylflfe their differential perf ormancev 

7 \ - t . 

Tabl^ 4 presents the results when the moderateid regression was 

Insert Table ^ about here 



used to search for patterns among th^ Institutional quality Indices which 
might lead to consistent patterns of ptedlctablllty and/or'unpredlctablllty. 
Unfortunately, since the moderated regression requires complete data, a 
number of cases had to be dropped from fhis part of the^analysis because* 
they were missing one or more Institutional quality Indices. 



As In the jcase of the biographical variables, only one quality Ind-ex 
to a repllcable pattern of differential predictability. That Is, there 
Is a slight but seemingly consistent tendency for students attending "low 
quality" Psychology departments to be more predictable. This result 
certainly comes as no surprise, since the so-called "higher quality" 
schools are more selective of applicants with respect to the ORE test^ 
scores and thus attainment of the Ph.D* ls\ll{ely to depend on some 
measured quality* It Is, however. Interesting to note that at the " 
quality" Psychology departments, the probability of obtaining the Ph, 
is consistently less than at tfie "higher quality" departments. 



Table 3 presents results when grouping was done on both age and the 
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departmental quality^ Index. Althc^ugh^the pattern o£ pr^lctablllty Is 
* less clear- cut, there remains , a teiyiency for' the older s^eptp attend- 
ing '*]rf>Wler quality institutions to be more predictable. In this 
fojLir-way break-ojur, the sample sizes are ratlier^ small and the resulting 
instability of the parameter estimates makes any further int£Qrpreta(ions . 
of these results rather tenuous; . , ^-^ 

In or^er to .determine the utility' o& age^and departmental quality" 
as potential predictors, they \4ere incorporated info stepwise prediction 
equations in both their -H^^^^ r^rm and as bi-Iin'ear cross {Products with' 
the reaaaining'p^^cfictors. In n6 form did they consistently l^ad to an 
increment in predictioij over the original five predictors <GRE-Verbal, 
Quantitative, and Advanced, UGGPA, and reference - report average). 

It would appear that for NSF applicants' in Psychblogy, the utility 
of age 'information li^s pr^arily in separating out ^tho^ individuals 
for whom: (1) we^ have varying degrees of ,confidence in their 'predicted ; 
or expected achievement ^(in 'this case, Ph.D. attainment), and (2) 
motivational levels may differ* 

The results also suggest that where^there was ;iif f erentlal prediction 
^he overall e<^uation used within the groups was not noticeably infe^rior to 
the i^tfique group equation with respect to predictive accuracy. This-- ' 
Suggests that different weightings of the same predictor variables for 
different types of people (older versus younger, etc.) does not appear to 
be the answer* fhat ±s\ some individual^ seemed to be more o-r less 
predictable regardless of whether youv use overall i/eights or their own 
unique weights. It is possible that entirely different predictor measures 
muSt*be developed for the "unpredictable" people. This, pf course, is 
bejrond the 3cope 'of this study. ^ 

^fathematics ' - - - ' 



Table 6 presents the. single variable vali'dity coefficients for the 
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predictors and potential moderators or grouping variables* In general 
it appears that the criterion of Ph.D. at^ktment in Mathematics is con- 
siderably ^re predictable from achievemMj^aptitude , measures than w^s 
found to be* the c^se in Psychology. O^^fprfclcular interest in Table 6 
are, the correlations^ of .38 and fo;: the ^Advanced Mathematics test 
agaiMt the criterion for Safeple 2 And 2, respectively. The GRE-Verbal 



aud Quantitative, ^as well as undergraduate grade' point average, Uaye re- 
spectable although lower relationships vlth the criterion. Institutional 
quality Indl^ces such as Income per student , faculty per student, and 
departmental quality Index, also demonstrate stronger- relationships vlth 
Ph.D.* attainment In Hathematlcs. It niay welV be that the supcess^ul ' . 
completion of the Ph.D* program In Mathematics depends upon the assimi- 
lation of a relatively' structured body of knowledge vhlc^ In turn leada 
to more accurate assessments of any one Individual's standing with 
respect to this body of knowledge. . . 

Table 7 shows the dlfferenti^al prediction by age groups. The 
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multiple, correlation between the five predictors (GRB-Verbal, Quantita- 
tive, and Advanced, dergraduate grade point av^rage^ and referefixce 
report average) and Ph.D. attainment Is a quite respectable .40 In 
Sample 1 and cross-validates to a surprising .44 In Sample 2. Further 
Inspection o£ Table 7 Indicates that there Is little or no consistent 
differential prediction by ag^ grdifp.' Unlike Psychology, there Is a 
linear relationship between age and Ph.D. attainment. That Is, the 
older the NSF applicant, the less likely he Is to attain his doctorate 
within the cutoff- time of^thls study". As In Psychology, the ^'middle** 
and "older" NSF applicants had similar^ aptitude-achievement test scores, 
and when considered ^s a wl^ole had consistently lower test scores than 
the younger candidates. The one exception to the above findings was the 
Advanced test, where. the "older" N^F candidates were not only lower than 
the, younget candidates^ but_were also one-half standard deviation 6elow 
the "middle" age candidates. 

Table 8 preaents the multiple correlations within grbups based on 
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departmental quality Indices. As with e^e, there does libt "^seem te be 
any. consistent pattern of differential predlctabllijcy. 

Table 9 shows the multiple correlatlona within groups based on the 

\ ~T~"" ' 

Insfirt Table- 9 aj)0jit here - 



departmental quality index and^age* With one exception, there appears tio 
be little differential predictability wljthln these groups. ^Somewhat 
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surprisingly, the young who attend "lower quality" departments appear to 
be characterized by greater predictability than the^remaining groups*' 
In general, the mean ability-achievement scores for this group are below 
that of both the '^high quality" young arid the "high qualitjr" old, but 
slightly above those of the "low quality" old group. Because the "low 
quality" young group size is so small, any further interpretation isif 
probably unwarranted. As one would expect, the criterion means in Table 
9 indicate that the young applicants who attend institutions with "high 
quality departments are much more likely to attain the doctorate than 
are the older NSF candidates who attend institutions *characteri2ed by 
"low quality" Mathematics departments*. Vfhen age was included as a ' 
predictor, no increment was found in predictive accuracy above that 
which resulted from the use. of the orlg;Lnal five predictors,. 

Chemistry 

The single variable validity coefficients for the chemistry measures 
are similar both in level and pattern to those of the Mathematics NSF 
applicants. As in Mathematics, the ^GRE-^Advanced test Is the one best pre- 
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dictor ii\ both samples. However, among the Chemistry NSF applicants, 
undergraduate average, reference report average, and age demonstrate 
somewhat higher relationships yith Ph.D. attainment than do their counter- 
parts for the Mathematics applicants, Jn general, the level of correla- 
tions fQund in Chemistry yield additional support for th4 hypothesis that 
the so-called "hard sciences" may provide a more measurable domain with 
respect to criteria of success as well as measures of'past achievements 
or aptitudes. It i^ also quite possible that it is easier to specify the 
necessary skills which are prerequeslte to . success (Ph.D- attairinent. In 
this case) in the "hard sciences." 

^TaVle 11 pre^sents the differential prediction results by age groups 

Insert Table 11 about hBxe 



for the Chemistry NSF applicants. As in the case of the Mathematics 
applicants, there appears to be little consistent differential prediction. 
Prediction for Sample 1 is relatively strong considering ^he somewhat 
restricted nature of the sample. Surprisingly enough, the cross-validated 
multiple c^)rrelations increased from ,39 in Sample 1 to .53 in Sample 2. 

A considerably larger proportion of the NSF applicants in Chemistry 
do attain their Ph.D. than the Psychology and Mathematics NSF applicants. 
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Table 12 preeente the differential prediction within groype based on 

V 
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the rated "quality" of their Chemistry^ departments.^ ^As was the pa9e with 
age, there is little or no consistent differential predJcJtioti^. Table 13 
^ shows the within group multiple correlations ffhen both quality indices 



Insert Table 1> about here * 



and age are uaed as moderators. Once again, no consistent pattern of ' ^ 
differential predictive accuracy was^ evident. It appears that in the twp 
'*hard science" areas of Mathematics and Chemistry^ the assimilation of ^ 
knowledge in their patticular area aa in^asured by the Advantied sectdon of 
the GRE fa the om best predictor of PhiD. attainment^ regardless of a^e - 
group membership or quality of the institution of attendance* ^ 



Age was included as a predictor and unlike Mathematics or Psychology, 
it did add significantly j:o the prediction. It was the second variable 
after the GRB-^Advanced section to enter the equation. In an effort to 
gain some insight into this relationship^ the correlation between age and 
whether or not the atudent attended on a part-time basis w^s examined. 
This correlation was effectively zero (.02). Thus, the "older*' students 
in Chemistry are no more likely to attend on a part-^time basis than the 
othe^ age groups. 

The significant i>artial regreasion weight associated with age 
indicates that after the ability-'achievem^nt variables were controJLled^ 
there remained a significant amount of variance in age which. waa 
related to Ph.D* attainment. 'It would appear that additional biogtaphi* 
cal Information might prove helpful in untangling this relation^ip. 



Path Models 



In an effort to interpret the interrelationshipa among the multiple 
predictors and departmental quality ratjLngs^ as ^ell as to estimate the 
relative size of their direct and indirect effects on Ph.D. attainments^ 
path models were analyzed, the general implication in path analysis is 
that verbal theories concerning the relationships between certain vari*^ 
Abies can be translated into '^causal" models involving mathematical 
equations^ i^ the direction of cjausality can^be specified. Iif path 
analysia^ the direction of causality between any two or more variables , 
may be specified on logical grounds or on the basis of temporal sequence. 
* The ''causal** effect of one variable or another may have two estimable 
componentsj the dirfect effect (i.e. > unmedlated by any third Intervening 




variable) ani the Indirect effect whlcji, of course, mxsp take Into con- 
oSlderatlon intervening va^abra^. Xn general, when data Is collected 
longitudinally, many of th6 measures because of ythelr temporal nature 
make the> direction of causality explicit. / 

( 

Within the three graduate disciplines, ^he same hypothetical path, 
model was developed and tested. Figure 1 Qfresents the traditional i 
plQtorlal presentation of the. model to be/rested. The arrows going In 




Xfisert Figure 1 about here 



on6 direction specify the direction of causality. Arrows between two 
variables going 'iti both directions signify that the dltecti,on of 
J 'causality'* could not be determln^ oh rational or temporal grounds. 

The path coefficients are standardized partial regression 

coefficients and/are the unknowns to be estimated. The relative size 
of any given wel^h^ ('^ij) may be Interpreted as the relative dlifect 
Influence- of th^ variable on the jth variable. "Direct** In the 
sense. that It Is ji^flned as that Influence which remains after all 
other Independent^ variables In the causal equation have been controlled. 
For exampl'lr. If by^ Is twice as large as by^, then quality rating of the 
department is twice as important an estlmattor ^f Ph.D. attainment as 
scores on the GRE-Advanced test in determining whether or not one attains 
the Ph.D. If direction of causality is not known, the path coefficients 
are replaced by the slmpl^e correlation coefficient. 

Inspection of ^gur^e 2 shows jthe computed Psychology path coeffi- 



Insert Figure 2 about here 



cienrs indicating the* ''direct" contributions of the variables to the 
various dependeht variables in the model. For example, the path coeffi—. 
cient symbolizing; the influence of undergraduate grade point average 
(GPA) on' the^'iref erence report average^ suggest that DG(iPA is alfaost 
twice as important aa the individual's GRE-Advanced score in influencing 
the ratings derived from the reference letters. This suggests that the 
ref ei^EnceMetters are often written without knowledge of the GRE-Advanced 
scores of the N5F applicant. Although UGGPA has a greater influence on 
decision-making concerning Reference ratings, the GRE-Advanced test scores 
have by fat the largest single influence on Ph.D. attainment. 

, The correlation coefficients indicating the relationships between * 
both the 'GRJ^Advanced. tes^ scores and UGGPA on the departmental quality 
ratings, indicate that 'the GRE-Advanced test scores of the students 
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'^within the departipents have a considerably Btrouger relationship with the 
qual^y^rating tha^ jdid grades in undergraduate school. At this point it 
inlgi^t be instructive to point out that the arrows, (indicating direction 
pf influence)* vere drawn in both directions;- that is, quality of depart" 
jqi^nt ^may Influence botKUGGPA and GRE^Advanced test scores or vice versa. 
In:^Luence in one case may be Interpreted as that good qtwlity departments 
jitend to attract or select students with both high GRE sSSfes and under- 
graduate 'grad-e point averages. Another interpi;etation might j)e that the; 
department rating is^a function of the abilities of the students who' 
choose t6 attend that particular institution. The interpretation chosen 
tiere ^s that high quality departments put a greater emphasis on either 

' attracting , or selecting students witli high test. scores than theyldo gn 
attracting students vlth high grad^ poi^t averages. 

Figures 3 and 4 give die path coefficients for the Mathematics and 
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Chemistry data, respectively, and yield essentially the same results as - 
the Psychology data. As one might expect from the discussion of ^ the 
prediction results, the GRE-Advanced test scores reflecting knowledge of 
subject area have a greater influence on Ph.D. attainment in the "hard 
sciences*' than in Psychology. This is particularly true in the Mathe- 
matics area where the importance of the GRE*-Advanced test is -approximately 
five times that of the other predictors. A less obvious difference in 
the relativb iiU)ortance of effects occurs between Chemistry* and ttte 
remaining *two ^disciplines;" That is, in Chemistry, undergraduate .grade 
point average was both ^ove important in influencing'decisions with regard 
to referebce letters, but also had a greater influence on Ph.L^. attainment 
than in the other two disciplines. 

Figure 5 presents the reduced path models i.e., the pictorial 

) : 
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representation of only those "causal" effects which had an average path 
coefficient exceeding .IC^. Average is defined here as simply thfe arith- 
metic mean of corresponding path coefficients across the three graduate 
disciplines, The criterion for deleting effects not exceeding ;irO is 
'purely arbitrary but seemed to be a reasonable cut-off for this study. 
Werts (1967) also suggests this cut*-off as a practical criterion for 
ejliminating negligible effects. 

The reduced model makes clear the central nature of the GRE-Advanced 



test with respect to the predictiou^of P^^D. attainment^ as well as Its^ 
influence on earlier decision's such as reference . letter averages and 
finally quality ratings. The GRE-Advanced test was selected as' the xne 
test to be Included in the^path models, since It consisjtently had the" ' 
highest d-order correlation with the criterion a^ng the test scores. ^ 
In general^ path models are more interpretab^la^-when^ only one measure Is 
used to represent any given measurable^ domain^ since the inclusion' of 
man;^ similar measures .(measures, of the same domain) lead to-high co- 
linearities and thus unstable estimates of the path coeff icleijts . 

Conclusions 

It was found that the GRE-Advanced tests- were consistently the .be- 
hest .predictors of a criterion of Ph,D. attainment. However, the pre- 
dictive accuracy of the GRE-Advanced test varied considerably across 
graduate fields and in one case within a graduate field*. Th§t isV- " 
prediction on the whole was considerably more accurate- in the "Kard 
science" gradi^te areas of Mathematics and Chemistry than in Psychology. 
Within ithe Psychology area ^here was a "U" shaped relationship between 
predlctaliilfty and age. Tiiat is, the total sample regression^ equation 
led to gt'eater predictive accuracy for the ''younger** and the "older'* 
age groups. The "middle" age group was not only less predictable but" 
*the errors in prediction tend to lead to underestimation of their 
actual rate of Ph.D. attainment. Thus^ the "middle" age group was . 
characterised by over^chievement . 

Path analysis models were applied to the intercorrelati'on matrices 
in an effort to determine the .effects of each of the predictor variables 
on the criterion ^s.well as on other intermediate decision-making 
processes. The resulting path coefficients supported the notion that 
the GRE-Advanced test was measuring' a domain of knowledge which was 
critical to '?h.D. attaloment within thVspecified time limit. 

V ■ ' 
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1. The author wishes to thank Dr. Llndsey R. Harman for his assistance 
in making the data availably for this study and his helpful suggest! 
during the early part of the data analysis. 
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vaudity coefficiekts, means r and stahdabd • 
/' . eeviaiions of ,xhe pjedictor?' for samples *1 aito 2 
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.1*8 


Age ^ 


-.05 . 


23.37 


3.70 


-.03 
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.06 


9.07 
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Income /Student 


.15 


8.75 


1.77 


. .05 


8.71 


1.97 


Faculty/student 


.13 


6.36 


3.pi* i 


' .07 


6.1*5 
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Percent with I1i*D. 


. ' - .02 


7.19 


3.06 ■ 


.01 


. . 7.13 


3.11 


Dept. Rating 




1.67 
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-.16 


1.66 


1.29 


GRE-V 


. .12 


63.52 


8.25 . ■'■ 


.19* 


63.1*7 


9.2? 


GRE-Q 


.33 


59.89 


11.31* ' 


.11* 


60.96 


10.82 


GRE-Adv* 


.19 ' 


60.98 


8.90 
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60.87 
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Ref. Average 


.16 


1*3.86- 
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8 .49 


TJGGPA 
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TABLE 2" 



DIFKERENTIAL PHEDICTION WITErK'"GSQUPS BASED ON AGE 

(PSrCHOLOG^)' * 







#V. 1 


2 


5 


Total ] 






^] ' younger 


Middle 


Older 










N=6l 


N=lv6 ' 


K=1^62 




Wtthin*Group 

Multiple B's ^ 










ERIKAKf 


> Group Equations 

Total Equations 
* 


.55 ' 
.51 


' .55 
.27 


.1^7- 
-.1*5 


•55 


* 


■ Moderator Means 
(Age) ' . 


ai.82 


25.lt8 




* 




Criterion Means 
(l=Ko"PhD; 2=?h2)} 


\ 1.^ . 


1.52 


1.28 . 


i.i^i 






Tl=5^ ■ 


N*77 


K=57 ■ 


K=U68 




' Within«Group 
' mtiple R*s 










CROSS- 


Group Equations 
Total Equations^ 


.25 
.27 


.15 
.lit 


'.25 


.21; 


validahon 

SAMPLE 


Moderator Means^ 
(Age> . ^ 


21.87 


25.69 


55.00 






Criterion Means 
■{l=Ko PhD; 2=PhD) 


1.1*0 


1.1*6 . • 


1.52 . 


i.in 


a ■ ■ * - 
^ Correlation between observed and predicted score when predicted scores were obtained 



using regression weights from the total primary sainple. 



ERJC 



P!RED:fCTOR MEAS3 AflL STANDAR^ CBVlATIQrB FOR THE PSTCHOLOGr AGE GROUPS 



Sample 1 



Group 1 
N=555 



&o\xp 2 
N=6l 



Group 5 



pK^dictors 


X 


cr 


X 


cr 


X 


a. 




64.17 


8.45 


62.41 


7.84 ** 


62.52 


9.3^ 




' 61.17 


11.17 


57.44 


9.64 


56.78 


U.48 


GPX-Adv. 


62.16 


8.36 


58.56 


8.48 


57.76 


10.39 


Reference Reports 


44.33 


8.15 


44. 51^ 


8.70 


43.09 


8.89 


UGGPA 


242.67 


39.17 


236.18 


' 44.21 


241.43 


42.41 



t'Icderator Mean (Age) 



21.82 




25.48 



32.54 



SaBiple "2 



Group 1 
N=354 



Group 2 



Group p 
N=37 



Etedictors 


X 


cr 


X 


cr 


X 


or 


GSE^V 
GRS-Q 
GRS-Adv. 

Reference Reports 
UGGPA 


64.90 
62.23 
62.15 
'54.52 

240.69 


9.04 i 
10.48;- 
8.33 i ■ 
8.59; 

41.44 ; 


60.19 
58.26 
58.52 
41.77 
- 225.92 


9.19 
10.28 

9.69 
9.56 
45.23 


61^ 

' .56.58 
40.16 
234.08 ' 


9.62 
U.74 
K>.3U 

8.55 
45.86 


Itoderator Mean (Age) 


21.87 


1 

i 

1 

( 

V 




25.68 


55.00 





. TABLE k 

* 

\ * 

DIFFBBESIZIAL PHEBICTION WITHIN GROUPS BASED ON EEPAKEMENT QUALITy INDICES * 

(psychology) 





* 


■ 1 


•2 


3 


Total 




- 


Hi -Quality 


Med**Qi;;^}..lty 


' Lcw-Q^ality 






1 


N=271 


N=49 








Multiple B's 




J* 






DP7VAT7V 


Total Equations 




.50 


. - 
.■27 






{Qusftity Index) 


1.00 




>^oa 


1.68 




Criterion Means 


XM * 


x,kb 


1.26 


l.JfO 






JI=282. 




" N=6o 


Jl=!598, 




Withln-Group 
* Multiple R's 










CROSS- 


Group Equations 
Total Equations 


.12 
.1^ 


.06 . 
-.15 


.22 
.51 

> 


. .15 


VALIDATIOM. 


Moderator Means 
{Quality Index) 


1.00 


2.52 


U.OO 


1.67 




Criterion Me^ns 
(l=h'o PhD; 2=PhD) 




1.52 


J.-26 . 


1.59 



a ^ 
Correlation between observed and predicted score when "predicted scores were obtained 

. using regression weights from the^otal primary sainple. ^ 



TABtS 5 

DIFFERENTIAL PREOICnON WITHlSt GROUPS BASED OK DEPARTMENT QUALITY INDICES AND STUDENT AGE 



/ 



(psychology) 







1 


2 


y 


1^ 






HI- 


-Quality 
Young ^ 


Lew-Quality 
Somevhat Older 


Low-Quality- 
Young 


Hi-Quality 
Older 








N«266 


N=39' 


Nf52 


N=23' 


N«'580 




Within-CSroup 
Multiple R's 












PRIMAHr 


. Group Equations 
Total Equations- 


.53 
.32 


•50- 
.58 


.25 


M ' 


• .35 


SAMPLE 


Moderator Means 
• (Quality Index) 
(Ace) 


1.07 
1.12 


3.69 

2.U 


' 3.56 

1.00 


3.00 


* 

1.68 
, 1.35 


t 


Criterion Means 
(l-rio PhD; 2=PhD) 


l^'^5 


1.56 


'1.51 


• 1.33 


l.'tO 




Within-Group 
Multiple R*s 


N=290 

if 




■N=J+9 


n=i9 ' 


N=398 


SECONDARY 


Group Equations 
Total Equations^ 


.12 
.12 


.22 ■ 
.27 


.10 
.05 


-.02 ■ 
.05 


.15 


SAMPLE 


Moderator Means 
(Quality Index) 
(Aee) 


1.07 
1.11^ 


3.77 
t 2. 1^2 


3.59 
1.00 


1.26 
3.00 , 


• l.|56 
l.Jit 




Criterion M^ans 
(l=No PhD; 2=PhD) 


, 1.1^3 


1.1^2 


i.22 


1.21 


a. 39 



Correlation between observed and predicted score when predicted scores were obtained using 

regression veights from the total primary sample. 

7 



o ^ 



' TABLE 6 • • 

VALIDITY coefficients/ MEANS, AND STANdIrD 
DEVIATIONS OP THE PREDICTORS FOR SAMpbs 1 AND 2 

(MATHEMATICS) ' ' 



Sample 1 N=l;25 







■ X 




Criterion 




1.5*^ 


.50 ' 


Age 




22.55 


2.06 , 


No. of Books 




9.92 


.1^0 


Income/student 


.20 


9.55 


1-55. 


Faculty /student 


.15 


7.98 


' 2.67 ^ 


Percent with Ph.D. 
Dept. Rating 


.06 


7.55 


2.88 


T.l8 


1.6o. 


"l.*09 


GRE-V 


* .27 


62.515 , 


10.96 


GRE-Q 


.27 


72.67 


. 9-51 


GR5"Adv. 


'.58 


65.95 


15.59 


Ref. Average 


.25 


^ 1^2.60 


9. '58 ^ 


UGGPA -> 


.a 


' 252.60 


U0.22 


App* Made . 


•5,2 


2.52 


1.52- 



Sample . 2 N=422 

r X tr 

- , 1.5"^ 

-.18 , 22.71 2*50, 

.10 9*90 .^^8' 

.17 ■ ' 7.2k ' , ■ 1.55 

,15 7.57 2.88 

• .15 7.61 " 2.86 

-.29 'i.65' ■ 1.15 

.52 * 62.65 ' 11.55 

.26 ■ 7i.5if 10. 1^ 

M 6lf.95 " 15.9*^ 

.27 V2.59 9.69 

.2^ 2^8.77 '^5.'13 

.50 ■ 2.57 , 'l>6l 



or 





.4 ' • ■ 












t 








1 




DmEREWTIAI, PREDICTION WrfiHN GROUPS BASED CSJ ASE 










(MATHEMATICS) 






1 

r' 






1 . 

■ Younger 


a ' J 

Midale . 


' "dloWi' , . 


■ Totea 






N=.558. ' ' 


. H=5i:' 








' Multiple R*s 




- 


> 




PRIMAICr 


C^oup Equations 
Total- Equations." 


.55 
.55 


^ .66* 
• 50 


>8 • 
.38. 


- M 


SAMPLE 


Moderator Means > 
, (Age J 


21.65. 


* ' J' 


27.59 


22.35 ■ 




Criterion Means 
(l=No PhD;.2=EhD) 


1.58 


l.U 


1.52 


. 1.54 




* 


N=525 


N=58 


■ ' N=59 


* 

N=It22 




'Wi thin-Group 
•Multiple R's 










CROSS- 


Group Equations 
Total Equations^ - 


M 1 
.1^5 ' 


.55 ' 
.1;!; 


.28 

.59 - 




VALUATION 


Moderator Means 
(Age) 

Criterion Me.ans 
, (l=No PhD; 2=P1iD) 


21.60 

1 

1.59 


21;. 81* 
1.1*5 


nil 
20.7^ 

I.5S 


■.A 

22.71 

l.Jfe 



as 

Correlation beWeen observed and predicted score when predicted scores were obtained 
using regression weights f^rom the total primary sample. ^ 



^ TABI£ 8 . , ^ ' 

DIFFERENTIAL PREDICTION WITHIN GROUPS EASED ON DEPAMMEKT QUALITy JKDICES 





\ '(maihematics) 
















Total 






Hl-Quality 


Med-Quallty 


Low-Quality ' 








N=517 


11=52 








^t/ithin-G^oup 
Multipie R's 












Group Equations 

^^^^^ A T 1d^.A-4«#'l^ 4 rf^WK M 

roiiaj. ij^^mons 

r;oderator Means ^ 
y I OuaJ_itv Tndexl 


1.00 


•57 

,,2.75 ' 


-6o 
k.oo 


.1*0 
1.6o 




Criterion Means 
, (l=No PhD; 2-PbD) 


1.61 


l.ltO 








— * ' ^ 


N=3o8 




N=65 


N='^22 




Wi thin-Group' 
hfuXtiple R's 










validation 
sample/ 


Group Equations^ 
* Total Equations^ 

Moderator Means 
(Quality Index) 


^9 

-^^1.00 


:g.6l 


.26 
.2t^* 

t^.00 


M 

1.65 




Criterion Means 
(l=No ?hD; ?=PhD) 


1.62 




1.29 


. 1.5"* 



^Correlation between observed and predicted score whep predicted scores were obtained 



usiig regression weights from the total priinary sample. 



TABLE 9 ; • . ' 

DUTEEEirriAL PREDICTION WITHIN GBOUPS BASED CW EEPAREMEMT QJIAJiITY INDICES AND ASE 

(MATHEMATICS) 



r 







1 


^ 2 


5. 


' 4 


Total, 




' Hi- 


-Quality 


Lav-Quality. 


Hi-(iaallty 


Low^Qwallty 






Within-Group * 
Multiple R*s ^ ^ 


N=io6 




N=2U 


N=82 


N-425 




Group Equations 
Total Equations 


.20 , 
.17 


.52. 
.58 . 


.1^0 
.59 


.»tO 




SAMPLE ■ 


Moderator Means 
(Quality Index) 
(Ace) 


1.00* 
20.64 


20.88 


1.00 

22.91 


5.54 
23.56 


1.60 
22.35 




Criterion Means 
^ (l=No PhD; 2=PhD) 


1.69 


1.1^2 


1.57 

• — 


1.55 


1.55 




— I' ■ 

Within-Group ' 
Multiple Rls 




N=17 


N=i9i^ 


' N=97 


N-422 


SECONDAIiX 


Group Equations 
Total Equations^ 


.51 

.55 ' 


.75 

- .65 


.56 
.56 


• .29 
.51 




SAi^PLE 


Moderator Means 

{Quality 'Index) 
' (Age) 


1.00 

20.78 


5.29 
20.55 


1.00 
, 25.07 


3.1^2 
2i^.6l 


1.65 
22.71 




Criterion Means. 
j(l«Ko PhD; 2^PhD) 


1-75 


' ,1.55 


1.56 


3-51. 


1.55 



^Correlation beWeen observed and predicted score when predicted^ scores were obtained usiri 
regression weights from Jihe- total primary sample.. 



( ' 



~ ' ■ ' ' TABLE 10 , ' 

VALIDITY QOEFFICIENTS , MEANS, AND StANDARD 
\ DEVIATIONS OF THE PEEDICTOES FOR SAMPLES 1 AMD 2 

(GIffiMISTRY) 



Sample 1 N=522 ' Sainple 2 N=521 





r 


3c 






1 X 




Criterion 


- 


J. 75 






1^7*^ ' 


M 


Age 

No. Of Books" ^ ^ 


-.29 


22.10 


' 1.81 


^28 . 


. 22.26 


1.82 


.08 


9.82 


.59 


V , .01 


9.8it ' 


.55 


Income/student 


.12 




1.12 


.14 ' 


9.2tt 


■ 1.31^ 


Faculty /student 


.08" ^ 


7.89 


2.66 


.04^ 


7.57 ^ 


2.89 


Percent with Ph.D. 


-.05 


7.11- 


2.99 


.12 


7.07 




'Dopt: Rating 




- 1.56 


.79 


-.22 


1.59 


.86 




.15 


59.66 ^ 


10.69 


.25 


58.1^0 • 


00.75 


GRE-Q 


. .28 


69.26 


10.70 




67.96 


10.70 


• 

GRE-Adv. . 


.55 


67.^^1 • 


U.81 




66.27 


12.51 


Re'f. Average , 


.50 


4l.f^8 


9.89 


^55 


'^?.25 


9.15 


UOGPA 


.27 


2*^6.95 


Mf.55 


. .56 


^21+7.95- 


■ i^2.02 


App. Made 




2.f^5 


l.f^8 - * 


-.59 


2.51^ 








** 








1 

1 




T — 


TABIB U 










• bll^FERjEITEIAL PREDICTION WTpSJN (SROUK BASED ON AGE 


- 








{CHEMISllEr) 












1 


2 


5 


Total 






Yoxmger 


Middle 


Older 


• 


> 




N=Ul* 


N=176 


Ni=52 


N«5S2 


f 


■ .Wlthiji-Gtoup 
Multiple R*s 










JrnJLn/Uu 


»Gijo\ip Equations 
Total Equations 


.29 
. .28 


.1*7 
.1*6 


•21 

.05 


■ ■-. 0 

22.10, 




'Mo'dei;ator Means 
. ^ <A6e) 


20.78' 


22.16 


26.1*4 




Criterion Means 


1.82 


1.75 


1.1*7 


1.75 


f 




N=95 


N=ie8 


N=1*0 . 

• 


' - N=52l 




Multiple ft's 










CROSS- 

VALIDA7I0H 

SAMPLE 


Group Eqiiations 
. ' . Total Eqxiations^ 

Moderator Mearis 
(Age)- 


.28 ■ 
•51 . 

20. 78 


.57 

•58 , 
. 22.15 


.15 " 
.55 

26.50 


.53 
, 22.26 




Criterion Meecns 
{l=No PhD} 2=PIiD) 


. 1.78 .' 


1.79 - 


. 1.1*0 


/ 1.71* 



a ^ ' 
Correlation between observed and predicted score- when predicted scores were obtedned 

using regression weights fjrom the total primary sample. 



TASIJB 12 -'v ' 

DITTERENTIAL PREDKTTION WITHIN GROUPS BASED "ON nEPAKCMENT QUALITY INDICES 







1 


2 


5 


Tot a] 






Hi-Quality 
- N=255 


Med- Quality 
N=52 


Low-Quality 
N=17 






WithiH'^Group 

Multiple ^^*s , 












' Group Equations 
Total Equations 


.59 
.58 ■ 


.58 


.55 - : 
.27 


.59 


SA^SPLE - 


. I'toderator Means 
(Quali^^ Index) 


. i.OO 


2''. 2 5 


- * 

t^.oo , 


1.56 




Criterion Means 

C>J!o.PhD; 2=PhD) - 


1.77 


1.69 


1.55 


1.7^^ 




\ 






N=25 . 


K=521* 




Wifehin-Group 
^ Multiple R^s ^ 










CROSS- 

VALIDATION 

SAl'IPLE 


Group Equations^ 
Total Squations 

Moderator Means 
(Quality Index) 


.t^9 
.50 

1.00 


. .50 
2.27 


.05 

.65 

■' Mo 


» .55 
1.59 




- ■ , Criterioi^Means 

(i=N^hD; 2=PhD) 


1.77 


'I.70 


l.t^5 





^Correlation between observed and predicted score when predicted scores weij^ obtained 
using regression weights from £he total primary sainple. 







TABLE 15 








J BIFEEREHTIAL PREDICTION WITHIW GROUPS BASED OS DEPAHIMEJJT QUALTIY INDICES AND AGE 






' t 


, CcHE^^I5TRy) ' 












1 


2 


3 




TcFta 




Hi- 

/ 1 


-Quality 
Young 


Low-Quality' 
Young 


Hi-Quality 


Low- Quality 






Wi t hln-GrouD 
Multiple R's 


N=2l»t^^ 


N=l8 
b 




K-12 


N=322 

r 


PRIMAEr' 


Grotxp Equations 
Total Equations 


.38 
.37 - 


.80 


.25 
.19 


.81^ 
, .25 




SAJiPLE 


Moderator >Iean3 
f Quality Index) 
(Age) 


1.13' 

ai.t^7 


3.50 
2l.t^5 


. 1.17 
' 2t^.72 


* 

3.67 
25.27 


1.36 

^22.10 




Criterion Means 
{l«Ho PhD;v2=FhI3) 


1.82 


1.72 


1.52 , 


1.35 


i.7r 




Wi thin-Group 
Multiple R's 


N=^30 


N==26 


.N=56 


K=9 


K=521 


SECONDAKT 


Grotxp Equations 
Total Equations^ 


M ' 


.57 * 


• .58 


.25 

■ ' .52 


.55* 


SAl^PLE 


Moderator Means 
(Quality Index) 
(Age) 


21.5*^ 


>> 

3.69 
21.69 


■ 1.16 
2t^.93 


3.56 ' 
25.67 


1.59 
22.26 




Criterion Means 
^l=No PhD; 2=FtLD) 


1.81 


1.69 


1.5lf 


1.22 


1.7^ 



Correlation between observed and predicted score when predicted scored were ootedned using 
regression weights rrom the total primary sample. 
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Fig. 5. Reduced Model Average Path Coefficients 



Appendix A 



Supplementary Analysis of Within School 
Validity Coefficients 

Following the release of the non-technical report* on this project^ 
questions as to. the value of the data presented to the chairman of a 
particular department were raised^ Theae were primarily concerned wltb 
the effect of between-school differences on the correlations between the 
predictor variables and the criterion of degree completion. It was 
suggested that the results would be more useful to department chairmen 
If these between-schopl differences were removed a^d the correlations 
recomputed. The resul'tlng correlations would give a more direct ariswer 
to the question: 'Vlthln a given Inatltutlon^ tow much help ar£ age^ 
GRE-V, GRE-Q, GRE-Advanced ^ Reference Average, and Undergraduate Grade 
Point Average fn predicting completion?'* 

To, remove between^school differences, all variables describing 
individuals were measured as deviations from their respective achool 
means. We were then able to pool the data .across schools and thus 
arrive at a single estimate which may be considered a kind of weighted 
^average of the withln-school validity coef f Icients « 

Table la presents both the 0-order validity coefficients as well 
as the correlations based on deviations from school means for the 



Insert Table la about here 



Mathematics NSF applicant samples. The deviation correlations are 
somewhat smaller than the simple 0-order validity coefficients as one 
mighc expect since in a loose sense they are partial correlations with 
the school effect partialled out. When the deviation correlation^ are 
compared with the 0-order correlation, the predictors of Ph.D. attainment 
maintain approximately the same rank order with respect to their accuracy 
of prediction. That is, the GKS- Advanced remains the best single pre- 
dictor of doctorate attainment* The second best predictors were GRE- 
Verbal or -^Qualitative , closely followed by either Undergraduate Grade 
Point Average or Reference Average. This general rank ordering was 
consistent acroas both mathematics samples. 



The prediction of doctora*te attainment is Psychology, Mathematfcs, 
and Chemistry. Graduate Record Examinations Boards Preliminary 
Report, Educational Testing Service, Princeton, New Jersey. 
August 1972. 



Table 2a presents similar data for the two samples of Chemistry NSF 
applicants, Once again, the single best predictor is the GRE-Advanced 



Insert Table 2a about here 



test. Unlike the Mathematics results^ there seems to be no consistent 
rank ordering for the "next best" predictors across both Chemistry 
samples*' It does > however, seem that Undergraduate Grade Point Average 
is a more accurate predictor of Ph.D. attainment for Chemistry NSF 
applicants than for Mathematics NSF appdicants. Similar conclusions <^ 
resulted from the path analysis approach^ described earlier. It is 
interesting to note that age tends to maintain its predictive accuracy 
after th§ school means are removed, This suggests that older NSF 
applicants (a^e measured at entry) appear to be less likely (or they 
take longer) to attain their doctorate in Chemistry. 



Conclusion 

The supplementary . analysis using individual scores as deviations 
from school, means do6s tend to reduce somewhat the size of the validity 
coefficients but the same patterns of predictive accuracy which were 
found when the data wer& pooled were maintained. Even though the 
validity is reduced the resulting coefficients are at a ^n^rally 
acceptable level for academic admissions purposes < f * 

These results suggest that further analysis does not seem to be 
varranted > ^ 



^ Similar to the goals of ohe deviation procedure^ path analysis 
attempts to control for school effects by incorporating depart-- 
^mental <iuality indices iri a pre-specif ied *'cau^al model,*' The 
resulting path coefficients are more closely akin to part cor- 
relations, however* rather than partial correlations. 



Table la 

CORRELATION COEFFICIENTS OF SELECTED STUDENT AND SCHOOL 
VARIABLES WITO DOCfORATE ATTAINMENT IN MATHEMATICS 



SAMRLE' I 

F 

N=423 



SAMPLE II 
N=422 



AGE ' 

GRE-V 

GRE-Q 

GRE-ADV 

REFER£N(::E 
AVERAGE / 



r^ 


X 


a 


r 




a 


X 


a 


-.17 


"22.35 


2.06 


-.10 




-.18 


22.71 


« 

•2.50 


.27 


62.95 


10.96 


.19 




.32 


6-2.63 


* 

11.33 


.27, 


■ 72.67 


9.51 


.23 




.26 


71.54 


16.14 


\S8 


65. 9 J 


15.39 


.31 




.44. 


64.93 


15,94 



.23 



42.60 



9.38 



.16 



.27 42:59 



9.69 



-.15 

.27 
-.17 
.36 

.19 



UND^tGRADnATE 
GRADE POINT ' 
'AVERAGE 



.21 



2.52 



.40 



.15 



.24 



2.49 



.43. 



.20 



. • ■ ■ ■ ' \ 

r is the simple product mcment correlation betVecn the selected variables apd Ph.D. attalnilient 
across all schools* ' 

"b ' a ' ■ ' 

r is the same as' r except all individual scores are deviations from the school means. This day 

be considered a kind of weighted average of the within school correlation. ' 
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a 



.Table 2a. 



CORRELATION COEFFICIENTS SELECTED STUDENT AND SCHOOL 
■ VARIABLES WITH DOCTORATE 'ATTAINMENT IN QHEMISTKy 



AGE 

GRE-V 

GRE-Q 

GRE-ADV 

REFEKENCE 
AVERAGE 

JJNDERGkADUATE 
GRADE POINT 
AVERAGE 





SAMPLE 


I 






N?322 




a 

r 


X • 


a 


b 

r 


-.29 


22.10 


1.81 


*.27 


.15 


59.66 


10.69 


.15 


.28- 


69.26 


10.70 


.28 


. '.33 . 


67^41 


11^81 


.31 


.30 


41.48 


9.89 


.26 


.?7 


2.47 ' 


.45 


.22 



SAMPLE II 
■ N=321 



-.28 
.23 
.34 

.,48 

.33 



.36 



22.26 
58.40 
67.96 - 
66.27 

42.23 
2.48 



1.82 
10.75 

7 

10.70 
12.31 

.9.15 
.43 



-.23' 
.15 
.24 
.39 

.27 
.35 



r is the'slraple product moment correlation between the selected variables and Ph.D. attainmfent 

t .across all schools. ' 

r la the same as r aj^^ept all individual scores are deviations from the school means. Thia may 

Y be considered a kind of weighted average of the within school correlation. 
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